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ABSTRACT 

The impact of introducing satellite temperature sounding data 
on a numerical weather prediction model of a small national weather 
service is evaluated. The Israel Meteorological Service model, a 
dry, 5-level, primitive equation model covering most of the Northern 
Hemisphere, is used for these experiments. Series of parallel fore- 
cast runs out to 48 hours are made with three different sets of 
initial conditions: 1) NOSAT runs, in which only conventional sur- 

face and upper air observations are used, 2) SAT runs, in which 
satellite soundings are added to the conventional data over oceanic 
regions and North Africa, and 3) ALLSAT runs, in which the conven- 
tional upper air observations are replaced by satellite soundings 
over the entire model domain. The impact on the forecasts is evalu- 
ated using three verification methods: 1) RMS errors in sea level 

pressure forecasts, 2) systematic errors in sea level pressure fore- 
casts, and 3) errors in subjective forecasts of significant weather 
elements for a selected portion of the model domain. For the rela- 
tively short range (^48 hours) of the present forecasts, the major 
beneficial impacts on the sea level pressure forecasts are found 
precisely in those areas where the satellite sounding are inserted 
and where conventional upper air observations are sparse - i.e., 
the oceanic areas. Both the RMS and systematic errors are reduced 
in these regions. The subjective forecasts of significant weather 
elements are also improved with the use of the satellite data. Of 
special interest is the result that the ALLSAT forecasts are of a 
quality comparable to the SAR forecasts. 
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ABSTRACT 


The impact of introducing satellite temperature sounding dc.(*a on a 
numerical weather prediction model of a small national weather service is 
evaluated. The Israel Meteorological Service model, a dry, 5- 1 eve I, primi-- 
t i ve equation model covering most of the Northern Hemisphere, is used for 
these experiments. Series of parallel forecast runs out to 48 hours are 
made with three different sets of initial conditions: 1) NOSAT runs, in 

which only conventional surface and upper air observations are used, 2) SAT 
runs, in which satellite soundings are added to the conventional data over 
oceanic regions and North Africa, and 3) ALLSAT runs, in which the conven- 
tional upper air observations are replaced by satellite soundings over the 
entire model domain. The impact on the forecasts is evaluated using three 
verification methods: 1) RMS errors in sea level pressure forecasts, 

2) systematic errors in sea level pressure forecasts, and 3) errors In sub- 
jective forecasts of significant weather elements for a selected portion of 
the model domain. For riie relatively short range (£^48 hrs) of the present 
forecasts, the major beneficial impacts on the sea level pressure forecasts 
are found precisely in those areas where the satellite soundings are inserted 
and where conventional upper air observations are sparse - i.e., the oceanic 
areas. Both the RMS and systematic errors are reduced in these regions. The 
subjective forecasts of significant weather elements are also improved with 
the use of the satellite data. Of special interest is the result that the 
ALLSAT forecasts are of a quality comparable to the SAT forecasts. 


I . I NTRODUCT I ON 


The concept of radiometric sounding of atmospheric temperature pro- 
files was first demonstrated with data gathered by infrared spectrometers on 
the Nimbus-3 satellite in 1969. Operational satellite soundings over oceanic 
areas were introduced by the VTPR (Vertical Temperature Profile Radiometer) 
instrument on the NOAA-2 satellite in 1972. Since 1979 (Smith et al 1979) 
the operational sounding system has been the TOVS (TIROS Operational Vertical 
Sounder) on the polar orbiting TIROS-N se*"ies of satellites. Early evaluations 
of the impact of satellite temperature soundings on numerical weather predic- 
tions showed only marginal improvements, except for the Southern Hemisphere, 
where, because of the sparsity of conventional observations, significant 
improvements were noted. More recent studies are somewhat more encouraging, 
Bengtssen et al., (1983) Halem et al., (1983). 


Most previous evaluations of the impact of satellite soundings on 
weather forecasts . ave been based upon forecast models used by the larger 
meteorological services of the world. In the present study we examine the 
impact of satellite temperature soundings on the numerical predictions of a 
rather small national weather service - the Israel Meteorological Service (IMS). 
In addition to an evaluation of the impact on the forecast atmospheric flow 
field, we also evaluate the impact on subjective forecasts of actual surface 
weather elements. Preliminary results were reported by Thomasell et al., (1983) 
and Wolf son et al., (1983). 
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2. ANALYSIS PROCEDURE 


ORIGINAL PAGE If 
OP POOR QUALITY 


2. 1 Exper i menta I Des i gn 

The experiment was performed 
numerical weather prediction model 
equation model. It operates at 5 
stereograph i c grid of 1844 points 
sphere. The grid Is aligned with 


with the Israel Meteorological Service 
, which Is a dry, 5- 1 eve I, primitive 
sigma levels defined on an octagonal polar 
(covering a large part of the northern hemi- 
5®W longitude, is offset from the North 


Pole toward the Med i terranean Sea, and has a grid mesh of 360 km, true at 
60®N, The integration domain is shown in figure 1. The model uses a 10- 
minute time step. The forecast variables are wind, absolute temperature 
and surface pressure. Geopotential is computed through temperature. 

Initial conditions, produced by a Cressman-type analysis (1959) scheme, 
comprise height and temperature at ten mandatory pressure levels from 1000 mb 
to 100 mb, plus surface pressure. Balanced winds are computed from the 
heights. For Input to the model, the analyses are interpolated to the 5 sigma 
surfaces, and for display, the information is interpolated back to pressure 
coordinates. In these experiments, the analysis procedure used a 12-hour old 
analysis for a first guess. Conventional data for this model comprise radio- 


sonde observations and standard surface and 
forecast runs were made with the model with 
data providing initial conditions. For the 
data cofl, rise conventional rawinsonde data, 
sounding data are added, and for the A! LSAT 
sonde data are excluded. 


ship observations. Parallel 
three different sets of upper air 
NOSAT experiment the upper air 
for the SAT experiment satellite 
experiment the conventional rawin- 


For the SAT experiment satellite sounding data were Introduced over the 
oceanic areas and over the North-Arican continent, where they supplemented 
sparse conventional data. For the ALLSAT experiment, satellite data were used 
over all of the area covered by the IMS model. All runs included sea level 
pressure as observed by the synoptic stations and ships. No aircraft or 
satel I i te-der I ved winds were used. As a result of this configuration of the 
operational system, the initia l sea level pressure maps are identical for all 
exper iments. 

The model was run in the form indicated in Table 1 for up to 48 hours. 

The forecast fields were available for 12, 24, 36, and 48-hour projections. 
Data sets were available for three different time periods and the details for 
each experiment are given in Table 1. In each experiment the NOSAT forecast 
errors provided the reference against which SAT or ALLSAT forecast errors were 
compared. 
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Table 1; Characteristics of the different experiments 


er j ment 
No, 

Per 1 od 


Number of 
Sate 1 1 i tes 

Time Window 
for 

Sate 1 1 ! ta 
Data 

1 nsertion 
(HR) 

Forecast 
Initial 
T i me ( (3MT ) 

Exper i ment 
Type 

1 

i-12 

Jan 

1980 

2 

+ 3 

00, 12 

SAT 

2 

’5-23 

Jan 

1979 

1 

-3, + 6 

12 

SAT 

3 

20-25 

Dec 

1979 

2 

+ 3 

12 

SAT 

4 

1-12 

Jan 

1980 

2 

+4.5 

12 

ALLSAT 

s 

20-25 

Dec 

1979 

2 

+4.5 

12 

ALLSAT 


The time window (around analysis timo) for the introduction of satellite 
data in the January 1980 and December 1979 data sets, when two operational 
satellites were available, was set to ^3 hours. This time range was considered 
to be a practical one for an operational system. It resulted in good data 
coverage for the western Atlantic for all the runs; however, the eastern 
Atlantic was only partially covered by satellite data at 12 GMT, and was not 
covered at all at OOGMT. Since, in regions of no observations the 12-hour old 
analysis defines the current analysis, a 12 hr discontinuity in the data was 
created along a line roughly north-south in the middle Atlantic. The time win- 
dow for including satellite data in the January 1979 (experiment P) data set, 

-3 to + 6 hours, was cnosen to get enough data from the one available satellite 
to provide adequate coverage for the eastern Atlantic ocean. The time window 
for the ALLSAT runs (experiments 4 and 5) was set to M.5 hours. This resulted 
in nea; ly complete coverage of the model domain by the two-satellite system. 

This paper will present and discuss results only of the Impact on the sea 
level pressure forecasts. It is felt that, because of sparse radiosonde cover- 
age over fhe oceans and the short range of the forecast, most of the impact 
should be found over the oceanic areas. At sea level, pressure is fairly well 
observed over the oceans; this allows the forecast fields to be verified with 
confidence there, 

3. RESULTS 

3. 1 RMS analysis 

The forecast sea level pressure fields were compared with their correspond- 



ing verifying analysis fields and RMS differences were calcjlated for each 
of the five verification regions for each of the five experiments, for fore- 
cast periods of 24 and 48 hours. These areas are presented in figure 1. 

The RMS differences for 48 hr are presented in Table 2, where a negative 
sign means that satellite data result in a beneficial impact. To help 
determine which numbers are significant. Student's t test was applied. We 
have adjusted the numbers of degrees of freedom to account for the siatistical 
dependence of consecutive days. 


Table 2: Average difference (SAT or ALLSAT -Minus NOSAT) RMS errors 

of 48 hour sea level pressure forecasts. Negative values 
indicate beneficial impact of satellite data. Statistically 
significant values at the 95$ confidence level are underlined. 

Exp, Exp, period Exp, type E. Asia Europe N. America Pacific 0. Atlantic 0. 


1 

1-12 

Jan 

1980 

SAT 

-0.5 

-0.1 

0.1 

-1.^ 

-1.1 

2 

15-23 

Jan 

1979 

SAT 

-1.4 

-1.0 

0.1 


-0.8 

3 

20-25 

Dec 

1979 

SAT 

-0.1 

-0.6 

-0.2 

-1.9 

-1.1 

4 

1-12 

Jan 

1980 

ALLSAT 

0.2 

0.3 

0.8 

-1.2 

-1.0 

5 

20-25 

Dec 

1979 

ALLSAT 

-2.5 

-0.5 

-0.2 

-5.7 

-1.0 


3.1.1 

! Experiments 

.1,2, and 

3, -SAT 

experiments 





Table 2 clearly shows that consistently beneficial impacts are found 
over the oceanic regions. For the Pacific Ocean the average reduction in 
RMS error is about 2 mb; for the Atlantic region the reduction is about 1 mb. 
The impacts over the continental verification areas are smaller but still 
ber. jficial, except for North Ame<'ica where there Is no significant impact. 
Western North America is very close to the model boundary and accurate repre- 
seniation of synoptic systems and especial ly jet-streams from westerly and 
southerly directions is difficuM. (^f the first three experiments, only 
experiment 2 had satellite data in trp eastern Atlantic; note the improved 
impact over Europe in this experiment. The results indicate that for these 
relatively short forecasts the largest Impact is located over the oceanic 
regions, where the satellite data are inserted and where conventional observa- 
tions are scarce, 

3.1.2 Experiments 4 and 5 - ALLSAT experiments 

Experiments 4 and 5 are all satellite data experiments. They examine the 
possibility of utilizing only satellite soundings for upper air observations, 
i.e. no radiosonde observations are used; however surface data are requi-'id 
to provide a reference level for [-he satellite soundings. The results are pre- 
sented in Table 2. 
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Table 2 shows that over the oceanic areas the ALLSAT shows lower RMS 
errors then NOSAT. The Improvement is more apparent over the Pacific Ocean 
than over the Atlantic Ocean. The results over the continental areas are 
mixed. For January 1980 they show up to a 1 mb increase in the RMS versus 
NOSAT and SAT, but for December 1979 an improvement is observed over £ast-Asia 
^ .rope and North America. 

3.2 Systematic errors 

This section deals with the geographic distribution of tiie systematic 
error of the numerical forecast model used In these experiments, and the Impact 
of satellite data on the systematic error. The mean or systematic forecast 
error at a gridpoint p is given by 

= ^1, ( V I P, •«) - V P/^)) ‘ ’ 

where Xf and are the forecast and the verifying analyzed values, respective- 
ly, and N is the sample size or number of maps over which the average is 
calculated. It is easily seen that 

Ex (p) = Xf (p) - Xa (p), (2) 

and that a field of systematic errors may be computed as the difference 
between fhe average forecast field and the average verification analysis. The 
importance of analyzing systematic errors lies in the fact that the sources 
for this error can usually be identified and even treated. 

The sysfematic errors and their differences were calculated for all five 
experiments. The Student t test at the 95| confidence level was used to deter- 
mine s i gn i F icance. From an examination of the results from all our experiments 
(not shown', the following can be stated; 

(a) Most of the impact is positive beneficial) 

(b) Impact was found in or very close to those areas where sat *'ite 
data had been inserted* 

(c) Most of the statistically significant impact areas are ass :iated with 
the presence of well developed lows e.g*, the Icelandic or Aleutian lows. 
The impact is usually found to the soutneast of the centers of those 
average systems. 

(d) The magnitide of the impact over the Atlantic Ocean is smaller 
than that over the Pacific. 

The above results suggest that the statistically significant (951 confi- 
dence level) contribution of the satellite data in reducing the systematic 
error is realized in the area of active weather systems. This is physically 
reasonable, since we expect that the satellite data, al'*'hough noisier than 
conventional raw Insonde observations (Gruber and Watkins, 1982) do have the 
capability of delineating the large horizontal temperature structure typically 
associated with active weather systems. Thus the signal to noise ratio is 
large enough to result in significant reduction of the systematic error. 





+J 


It was also found that negative impact occurs in areas of time 
discontinuity in the data. 

Such discontinuities can occur on the border lines: 

1) between those areas where satellite data are inserted and those areas 
which are not updated by either satellite or conventional observations, 

2) between neighboring swaths of observations taken by differs f satellites 
at different times. 

4. SUBJECTIVE WEATHER FORECASTING 

One disadvantage of the RMS measure of accuracy is that there is not a 
direct correspondence between reduction in RMS height or pressure errors and 
the quality of actual weather forecasts, which affect our everyday life. A 
more direct way to gauge the impact of the satellite data would be through 
the vehicle of subjective weather forecasts. 

4. 1 Subjective weather forecasting 

To evaluate the impact of the satellite sounding data on the routine 
weather forecasts, subjective weather forecasts were issued for a network 
of stations presented in figure 2. The stations are located about 500 km 
apart from each other so that synoptic scale effects could be detected. 

The forecasted elements were: wind speed and direction, cloud amount and 

type, and precipitation. Each element was forecasted independently. The 
forecasts were given In categories which are presented in Table I and were 
issued for 12, 24, and 40 hours. 


Table 1: Forecast categories for weather elements. 


Elements 


category 1 category 2 category 3 category 4 


wind speed (ff) 
wind direction (dd) 
cloud type 

cloud amount (N, octas) 
precipitation 


ff < 15 kt 
0* <dd £90* 
clear 
p< N £ 2 
yes 


ff> 15 kt 

90* <cld _< 180* leo* <dd 
low midd 

3£N£4 5£N 

no 


£ 270" 270" <dd £ 360" 

e high 

6 7 < N < 0 


4,2 Forecast procedure and verification 




The procedure for issuing the subjective weather forecast was as follows. 
First The forecaster was presented with two sets of forecast maps as produced 
by the numerical prediction r..odel with (SAT) and without (NOSAT) satellite data, 
but was not told which was which. He then issued two weather forecasts for each 
station using the two sets of numerical forecast maps. The number of maps aval I- 
able was limited because of practical reasons. The following maps have been used; 

(1) Current operational sea level pressure as analyzed at the IMS. 

(2) Forecasted sea level pressure and the 500-1000mb thickness. 

(3) Current and forecasted SOOmb height and vorticity. 
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The Hansen-Ku i ppers (HK) Score which is the hit rate minus the false alarm 
rate (Mason 1982) was used ^or verification purposes. This score has two 
advantages : 

(1) It discourages persistence or c I i mato I og i ca I I y based forecasts by 
resulting in very low scores for * n i s type of technique. 

(2) The score is independent of the frequency of the forecasted events. 


4.3 Results 


Satellite impact on the subjective weather forecasts may be evaluated by 
addressing the following problems: 

(1) What is the geographical distribution of the impact? 

(2) At what forecast time was the impact realized? 

(3) How was the quality of the forecasts changed? 


4.3.1 Spatial distribution of the impact 

The cumu'ative combined 12, 24, and 48 hours spatial distribution of th^» 
percentage of different station precipitation forecasts is presented in figure 
2. One may observe that there are preferred areas where the number of 
di: erent forecasts maximizes. The maximum difference area stretches from The 
lirranean Sea through L^ete to the northeastern corner of the Med i terranean 
Sea. This area coincides roughly with one of the frequent eye ionic tracks in 
the Med i terranean Sea. 

4.3.2 F orecast Qua I i ty 

The impact of the satellite sounding data expressed in HK units. In which 
a higher score means a better forecast, was calculated using the Impact for 
each station as an observation point. The Student t test was used to assess 
the statistical significance. The results are bhown in Table 4. 


Table 4: Average HK scores for precipitation forecasts 

with and without satellite data. 

(significunt results at the 95f confidence level are underlined) 


January I960 January 1979 


Time (hrs) 

12 

24 

48 

12 

24 

48 

HK with satel 1 it. 

.5S 

.43 

.28 

.35 

.44 

.27 

HK w i thout sat. lilt. 

.49 

.35 

.29 

.3« 

.35 

.30 

Impact 

.06 

.08 

-.01 

.04 

.09 

-.03 


Most of the Impact is positive but not always statistically significant. 
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5. CONCLUSIONS 


0^- results indicate t a srr.a ! I nationo! weathe. service using a 
modest * erica! weather prediction model can improve its numerical pre- 
dictions of sea 'evel pressure and, through subjective i nterpreta f i on of 
the numerical predictions, its forecasts of significant weathar elements 
by including satellite temperature soundings in the initial conditions for 
the model. However, we believe that the degree of improvement fo be ex- 
pected will depend on the details o‘ the model’s analysis and forecast 
system. For example, the Israeli forecast mo'^.: uses a 12-hour old analysis 
as the first guess field for the current analysis* In sparse da^a regions, 
satellite soundings, despite their inherent errors, imorove the analysis over 
that based upon the .2-hour old analysis and a few current radiosondes. 

Models using a 12-hour forecast for a first guess field may show different 
impacts. 


Our ^isults indicate that forecasts based upon an observing system 
consisting of surface observations and satellite soundings may be Oerter than 
forecasts based on The convent. ,al surface and upper air ohscrv*r''i network., 
and are comparable to forecasts based on a hybrid satellite soundi^. and 
conventional data system. This result has important implications for the 
planning of future observing systems and should be verified in experimer, ,s 
with more s >ph I st i cated numerical forecast models. 
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